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Pointing out that student testing 
should take into account each school' r philosophy 
literature curriculum, this digest explores the or 
literature study and looks at specific objectives 
literature testing. The digest discusses answers t 
questions: (1) Where are the broad thrusts of the 
literature? (2) How can the content and objectives 
curriculum be specified? (3) How are test question 
(4) How is student performance judged? A chart of 
behaviors accompanies the text. (EL) 
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Testing in Literature 



Importance of the Question 

o 

y | Recently there has been increasing attention to testing of 
writing and reading, but no parallel growth of interest in test- 
ing of literature. This is unfortunate, not omy because testing 
affects curriculum but also because attention to the testing of 
literature can help teachers, English curriculum specialists, test 
makers, and teacher educators refine their understanding of 
literature and the way it is taught. 

In order to examine the domain of literature study and to 
suggest ways by which teachers might advance their own testing, 
one should look first at the broad domain of literature and then 
at more specific objectives and school outcomes. This process 
is necessary because literature curricula, even in neighboring 
schools, may well have quite different philosophies, and test- 
ing of student performance must take those differences into 
account. 

Where Are the Broad Thrusts of the Curriculum 
in Literature? 



In the United States, as around the world, there is no commonly 
shared view about a single broad aim of instruction in literature, 
although there is general consensus as to the range of major 
thrusts which differentiate one curriculum from another. Al- 
though these thrusts have been given slightly different labels, 
the definitions are stable: one literature curriculum focuses on 
texts and knowledge of the literary and cultural heritage of a 
group; a second focuses on the development of skilled readers 
and critics of literary texts; and a third focuses on the en- 
couragement of personal growth through reading and involve- 
ment with the text <Dixon 1966; Purves 1978; Mandel 1980). 
In any one school or department, the actual curriculum may be 
<\ hybrid of two or even all three of the thrusts, or the thrust 
may vary depending on the trace or level of the student. 

The implications of the three thrusts for testing are clear; no 
single test can cover all three. The first calls for measures of 
recall, the second for measures of skill, and the third for mea- 
sures of attitude. Literature teachers in a school system, there- 
fore, should first define the broad goals of the literature curricu- 
lum as it exists by examining the course of study, the textbooks 
and other materials, and the kinds of assignments equired wt 
the students. 



• Pomttof v«w or opinions ttattd nthiadocu 
mtnl do not neccsunty rtprtttnt official Nil 
position or policy 



rsi One way of performing this examination of th* curriculum i? to 
j^j^Qt forth the content of the curriculum and the kinds of be- 



How Can the Content and Objectives 

of the Literature Curriculum Be Specified? 



havion or activities emphasized in a grid (See Figure 1). Various 
curricula would make different applications of the principle of 
the grid and therefore different detailings of the content and 
behavior. From any grid, the crucial next step is to determine 
the emphasis of the curriculum for each cell. An historically 
based curriculum would probably stress \nov/ledge of specific 
texts, and contextual (background) and cultural information. 
A more analytic curriculum would stress application of critical 
terminology and expression of a preferred response. Determin- 
ing the relative emphasis of the various cells in the curriculum 
then leads to the development of a set of test specifications. 
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Figure 1 Grid of content areas and behaviors 

How Are Test Questions Developed? 

Once the curriculum has been analyzed, and once the various 
aspects of the domain of literature study that are considered 
important in a school or class have been determined, the next 
step is to develop a set of test specifications for that domain. 
These specifications would include, for each cell to be mea- 
sured, a clear statement of what the cell means, perhaps with 
examples; a statement of what t oe of measure (such as a true- 
false test, a series of essays, a performance, or a set of out of- 
class activities) would b*:>t let *n observer know what the 



students are doing with respect to that cell; and the criteria 
by which adequate or superior performance would be deter- 
mined. Such specification would then lead to the development 
of tests, questionnaires, and other measures that would in- 
dicate what the students have gained. The purpose of such 
specification is primarily to insure the fairness of the testing 
and the probability of comparable tests from semester to 
semester or year to year. In many institutions, these test speci- 
fications are made available to the students so that they are not 
surprised by the actual test or performance, and whey can better 
prepare. 

These specifications and the resultant u i to be ex- 

amined carefully to see whether the testing , > are appro- 
priate to the emphasis in the cells. For exam^e, if the cell to 
be emphasized is that cf expressing a response to a piece of 
literature, it would make little sense to develop an elaborate 
true-false or multiple-choice test; the emphasis of that cell is 
on expression, perhaps written, perhaps oral, oerhaps dramatic. 
Similarly, an out-uf-class essay on a play is not a good way of 
testing whether students can recall various characters, scenes, 
and lines in the play. In general, behaviors like recognition, 
recall, and even application are efficiently tested through 
highly structured approaches such as true-false or short answer 
Behaviors that call for expression require more extensive mea- 
sures that ask students to classify, analyze, interpret, or evaluate 
texts. In genera!, tc*\ the measures of these higher abilities 
should use texts that are relatively unfamiliar to the student 
rather than text extensively taught in class. With the previously 
taught text, tr s a greater possibility that the student is 
recalling clas* ,sion or notes rather than exercising a sst 
of analytic or i, . pretive skills. 

How Is Student Performance Judged? 

The final aspect of testing— scoring or judging and then report- 
ing student performance-is often the most difficult, particu- 
larly if more elaborate measures are used. It is one thing to total 
up a number of right answers, quite another to rate a piece of 
writing on the character of Stuart Little; still another to judge 
individual performance in a dramatic interpretation of a Winnie 
the Pooh story In the latter cases, judgments are being made 
about the rhetorical or dramatic skills of the students as well as 
their knowledge or understanding of the text. 



For the composition, many teachers seek to rate the quality 
of content and the use of evidence and reasoning, separate from 
rating the structure, style, and mechanics of the writing. The 
latter aspects are important, to be sure, but as far as perfor- 
mance in literature is concerned, it is the former th&t counts. 
Similarly, in dramatic interpretation the students' understand- 
ing of the characters and the dramatic situation should be rated 
separately from their skills in speaking, gesturing, and the like. 
Research indicates that the ratings of various aspects of perfor- 
mance are related to each other, but that raters aware of the 
relationships can make distinctions between the content and the 
form of a written or dramatic performance. For an overall grade 
in language arts, of course, teachers might want to combine the 
two, but for the literature aspect of the grade, the content is 
important. 

Finally, some cf the objectives of the literature curriculum 
are not subject to judgment as to good or bad, but simply to 
description by the teacher. These objectives concern attitudes 
about and interest in literature and literature instruction. It 
is extremely important for these aspects to be measured through 
some sort of questionnaire or informal interview, but the results 
might well reflect less upon the student than upon the teacher 
and the curriculum. Curriculum makers and teachers should 
consider the possibility that a literature course may produce 
students who are more knowledgeable but who do not want 
to read literature, or the course may produce students who love 
literature but have not learned anything. Ideally, the objectives 
in literature instruction should form a harmonious whole. 

Alan C. Purves 
University of Illinois 
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